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ABSTRACT 



The document, part tvo ct a six part project report, 
discusses the construction and validation of a three stage model for 
assessing ieviant behavior in children. The model was developed tc 
meet the projects measurement, identification and diagnostic goals. 
Stage one consists of a 50 item behavior checklist which was used as 
an liiitiaJ screening device. The scale is normed on elementary grade 
subjects; and item reliability and validity estimations are completed 
on the scale. Stage tvo consists of a 62 itefli behavior rating scale 
which is divided evenly between items tc measure acting out behavior 
and i te is measuring withdrawn behavior. A behavioral observation term 
was developed for the purpose cf measuring task oriented behavior. 

The ferm ullox; simultaneous observation of 13 tehaviors, and 
contains codes tor classroom setting, the social consequences of 
child nehavior, and the social agent supplying tiie consequence. 
Identif ica ticn data were collected in stage one and more specific 
data were collected in stages two and three tor diagnostic and 
treatment prescription purposes. Further details on the project are 
contained in section one (EC 032 20b) overview; section three (EC 032 
210) treatment; section four (EC U32 211) generalization and 
maintenance; section five (EC 032 212) teacher behavior; and section 
six (EC 032 213) single subject experiments. (CD) 
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I ntroduction 



This manual describes the construction, validation, and administra- 
tion-scoring procedures of a behavior checklist for the identification 
of children with behavior problems. The WPBIC is designed for use by 
the elementary teacher in grades one through seven and is composed of 
observable, operational statements about classroom behavior which were 
furnished by a representative sample of elementary school teachers. The 
checklist is to be used as a supplement in the total identification 
process rather than as an instrument to simply classify children as 
emotionally disturbed or socially maladjusted . The WPBIC should function 
as a tool which the elementary teacher can rely upon in the difficult 
task of selecting children with behavior problems who should be referred 
for further psychological evaluation, referral, and treatment. 

The Raters 

The classroom teacher is in a unique position to identify children 
with behavior problems since she spends more time in actual observation 
of the child than any other school personnel. Research studies have 
demonstrated that teachers are capable of raking valid judgements about 
classroom behavior (e.g. Stouffer,1952; Bower, 195^; Eeilin,1959; kaes, 
1966). The WPBIC consists of stimulus items which describe behaviors 
that interfere or actively compete with successful academic performance. 
The scale is thus especially suited for classroom teachers since accord- 
ing to Beilin (1959 ) t teachers are most concerned with classroom behavior 
which is disruptive of achievement. Since the teacher is held responsible 
for the child’s achievement through the teaching-learning process, she 
should be an excellent judge of classroom behavior which is incompatible 
with academic performance. The teacher is thus regarded at the most 
qualified rater in using the WPBIC to identify children with behavior 
problems who are in need of special educational-psychological services. 
However, ratings from other educational specialists such as counselors, 
remedial teachers, and school psychologists, vh. have worked directly 
with the child, can bo obtained for purposes of comparative- analysis. 

The Period of Observation 

A two month observation period should precede teacher ratings of 
child behavior on the WPBIC. A sufficient observation period increases 
the reliability and validity of the teacher’s ratings and also reduces 
the probability that such high magnitude, yet low frequency behaviors, 
as stealing, temper tantrum", and fighting will be missed by the teacher* 

The scale can be most efficiently used if the teacher waits approximately 
two months after the start of school and then rates each child in her 
class. Children who are in need of specialized educational services or 
those who should be referred for further evaluation and treatment can 
be identified early in the school year* Additional behavioral problems 
which may develop in individual children as the year progresses can be 
rated on the WPBIC as they occur* 
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Development and Standardization of the WPBIC 

Source of WPBIC Items: The fifty checklist items were drawn from teacher 

d'escrTp tTon s of classroom behavior problems. A random sample of thirty 
experienced teachers was drawn from the population of fourth, fifth, and 
sixth grade teachers in a local school district. The teachers were then 
asked to nominate those children in their classes who exhibited chronic 
behavior problems. Each teacher was then interviewed and asked to describe 
the child’s behavior problem(c) and to give operational descriptions of the 
behaviors that concerned them. Observable descriptions of overt behavior 
were abstracted from each interview, yielding an item pool of three 
hundred items. Fifty of the most frequently mentioned behaviors from 
this sample were selected for inclusion in the scale. 

Derivation of Item Score Weights : A panel of five behavioral scientists 

was selected and assigned an item rating task for the purpose of deriving 
score weights for individual scale items. The five judges were asked to 
rate each item's weight or influence in handicapping a given childs present 
adjustment. Judges rated each behavioral item’s influence on a twenty point 
scale ranging from of n£ importance to great importance . The scale was a 
continuum on which the judges could rate an item at any given point. Judges’ 
item ratings were pooled and averaged and each item assigned an arbitrary 
score weight ranging from four to one on the basis of such ratings. The 
results of the rating procedure and the assignment of score weights are 
presented in tables 1 and 2 below. 

Table I 

Mean Scores, Standard Deviations, and 

Inter-Rater Reliability (R^) f° r AH 
Judges on Fifty Scale Items 



Judges 


Mean 


S.D. 


11 1 


11. d 


4.1 


in 


9.5 


3.6 


#3 


9.5 


4.4 


#4 


11.6 


3.7 


in 


12,7 


3.5 




Inter-judge reliability: .83 





Since was .83, the means of the five judges on all items were pooled and 
assigned as score weights for the scale items. 
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Table 2 

Item Mean Scores, Score Weights, 
and Number and Percentage of 
Items in Each Category 



Mean Score 




Score Wt. 


N 






16 




4 


6 


12 




15 












14.4 




3 


8 


16 




13. 












12.Q 




2 


10 


20 




12 












CO 

«— ( 
*— 1 




1 


26 


52 




6.5 
















Total 


50 


100 





With this weighting system, a subject can receive a high score of one 
hundred and a low score of zero. 

No rmative P rocedures : I ems selected and weighted were incorporated into 

a behavior checklist and given to a twenty-one teacher sample of fourth, 
fifth, and sixth grade elementary teachers. Teachers evaluated all pupils 
in their classes on the checklist after having observed them for approximate 
two months in the classroom environment. Each subject evaluated on the 
scale received a marking of either present or absent for each item. Teachers 
were instructed not to single out problem children in their use of the scale 
since this would have undoubtedly biased results. This procedure yielded 
scores on 534 fourth, fifth, and sixth grade children. The mean score for 
tne normative sample was 7.76 with 'a standard deviation of 10.53. 

For purposes of screening and identification, it was necessary to select 
a point within the frequency distribution (checklist score) which would 
separate disturbed .from nondisturbed children with an acceptable degree 
of reliability and validity. However, as noted in figure 1 below, the 
distribution of raw scores was positively skewed and did not represent a 
normal distribution. 
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Figure 1 

Frequency Distribution of Raw 
Scores on Fifty Checklist Items 
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Since the WPBIC is composed of fifty negative behaviors, a positively skewed 
distribution would be expected when the scale is administered to a regular 
school population. However, in a residential treatment facility for rtvere+y 
disturbed children, the scale's application could conceivably resulc in a 
negatively skewed distribution as high scores indicate possession of a 
large number of deviant behaviors. Since behavioral adjustment is considered 
to be normally distributed in ordinary populations, the raw data on 534 
subjects were converted into a T score distribution so as to normalize the 
data and to establish separation points within the distribution. 

Table 3 

Summary T-Score Conversion Table 



T-Score 



Raw Score 



90 


50 


60 


41 


70 


31 


60 


21 


50 


11 


40 


1 



A T score of 60, which is the equivalent of one standard deviation above the 
mean, was established as the point in the distribution for separating disturbed 
from nondisturbed subjects. In using the WPBIC, subjects v/ho receive a raw 
score uf 21 (T score of 60) or above should be referred for a more intensive 
behavioral analysis and evaluation. 



Reliability of the WPBIC 



The reliability of the WPBIC was estimated by the Kuder-Richardson split-half 
method. The instrument wa3 divided into equivalent split-halves by selecting 
odd and even numbered items for inclusion iu the two half tests. In an 
effort to make the two halves of the scale more nearly equivalent and to 
reduce the response bias which operates whan a group of deviant behaviors 
cluster together in serial form, items and their equivalent score weights 
were distributed equally among the two half tests. Ona behavior with a score 
weight of four was assigned as item number fifty and another behavior with 
a score weight of four was assigned as item number one. This procedure was 
duplicated for the remaining forty-eight items by alternately assigning score 
weights of four, three, two, and then one to the two halves; of the scale. 

The split-half reliability coefficient obtained on the scale was .98 with 
a standard deviation of 10.53 and a standard error of measurement of 1.28. 

A coefficient of .98 indicates that 97% of the variance of test scores in 
the sample was true score variance and 3% is error variance. With a re- 
coefficient of .98, the scale is capable of making individual 
S< FRIP ns arnon 6 su *O ect3 with a considerable degree of reliability as an 
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r of .90 is the minimum coefficient acceptable for this purpose (Lindquist, 
1951). 

A formula was applied to the reliability coefficient in o]:der to determine 
the effect upon reliability of the UPBIC by first doubling and then tripling 
its length. By this formula, a one hundred item scale wo'tld yield an r of 
.99 and a cne hundred-fifty item scale would also yield au r of .99. The 
gain which would be realized by doubling or tripling the length of the 
present scale would be , Ox. The WPBIC, in its present fojjn, appears to be 
at its near optimum length at fifty items. 1 

Validity of the_ ^BIC \ 

Four types of validity were estimated on the UPBIC: contrasted groups 

validity, criterion validity, factorial validity, and item validity . The 
validity data were derived from the original normative sample. 



Contr a cted Gro ups V alidity : In the contrasted groups methed of assessing 

validity, two independent groups are defined in relation to the construct 
being measured and the instrument is then administered to both groups. 
Differences between the two groups in test score are then tested for 
statistical significance. (Levitt, 1960). Two independent! groups were 
defined in relation to the construct of behavior disturbance;*, Thirty-eight 
subjects in the 534 pupil sample were identified as behavitjrally disturbed 
according to one or more of the following criteria: 1. hasj been examined 

by a psychologist and referred to a psychiatric or clinicaj facility, 

2. specific educational provisions have been made for the Subject within 
the school setting because of his behavior problen(s), 3. j, as received 
instruction at home because of his inability to profit fre i classroom 
instruction due to his behavior problem(s). These thirtyq?ight subjects, 
so identified, v.ere matched with thirty-eight subjects frr;7> the normative 
sample, not so Identified, in terns of age, grade, and self. All pupils 
who matched the experimental subjects in age, grade, and \i ex were lifted from 
the sample. A table of random numbers was used to facilitate the random 
selection of thirty-eight control subjects to be paired v ith the experimental 
subjects tor purposes of experimental analysis. j 

Table 4 ! 

Mean? , Standard Deviations, and N*s of Experimental 
and Control Croups with Test for Statistical Significance 



b ap e rim e ntalQ JOB) 



Control (iV=38 ) 



VI 



CP 



X 

16. G3 



S.D. 

12.68 



X . S.D. 
6.47 5.47 



10.16 



4.23* 



El\[0^ cant beyond .001 level 
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The difference between the means of the experimental and control subjects 
was significant beyond the .001 level of confidence* Contrasted groups 
validity can be reasonably claimed for the UPBIC since behavioral ly disturbed 
subjects received significantly higher scores on the construct which the 
scale measures than did nonbehaviorally disturbed subjects. 

Criterion Validity: k biserial correlation was computed on the normative data 

to assess the degree of relationship which exists between scores on the UPBIC 
and the construct of behavior disturbance as measured by the three criteria 
discussed above. If the scale measures disturbed behavior, then it appears 
reasonable to expect that scores of subjects who have been referred to 
psychiatric or clinical facilities or those who require special educational 
provisions because of such behavior problems should correlate higher with the 
criteria, of behavior disturbance than scores of subjects who are judged 
not in need of such attention. 

The biserial correlation between checklist score and the criterion 
yielded on r. . of .68. The standard error of this correlation is .039 
and its index 1 cf predictive efficiency is .33. The r\. o of .68 is signifi- 
cantly different from zero at the .01 level. The predictive efficiency 
index of .33 provides a measure of the scale f s predictive value and 
indicates that the UPBIC has utility in the prediction of behavior disturbance 
in populations of elementary school children. 

Factorial Validity : Data obtained from administering the UPBIC to a 534 

pupil normative sample were factor analyzed according to a diagonalization 
method orginated by Jacobi and adapted by von Neumann for large computers, 
Ralston and Wilf (1962). The factors were then subjected to a Varimax 
Orthogonal rotation to obtain a. simple structure. This procedure yielded 
five factors which are presented in Table 5 along with their constituent items 
and factor loadings, 



Table 5 

UPBIC Factors, Items, and Factor 
Loadings for a Sample of 534 
Public School Pupils 



Factor 


Item 


Factor Loading 




1. Acting-out Syndrome 


1 


.63 




disruptive, aggressive, 


4 


.74 




defiant (14 items) 


12 


.66 






16 


.55 






18 


.72 






21 


,49 






27 


.63 




O 

ERIC 


30 

31 

32 


.63 

.60 

.69 
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2. Withdrawal S yndrome 

(restricted functioning, 
avoidance behavior) 

{ 5 items) 



3. Distractability 

(short attention span, 
inadequate study skills, 
non-attending) (11 items) 



4 * Dist urbed Peer Relations 
(Inadequate social skills, 
negative self-image, compul 
sive) (10 items) 



5. i mmaturit y (dependent) 
(10 items) 



0 




.64 

.39 

.74 

.77 

.54 

.57 

.67 

.75 

.79 

.49 

.30 

.81 

.49 

.69 

.40 

.41 

.35 

.67 

.79 

.46 

.50 

.55 

,61 

.73 

.72 

.56 

.33 

.77 

,55 

,o5 

.32 

.56 

.59 

.69 

.67 

,79 

.73 

.74 

.35 

.82 



35 

38 

39 

46 

15 

29 

37 

42 

45 

3 

6 

9 

10 

13 

14 

.19 

24 

41 

49 

50 

5 

7 

23 

25 

26 

28 

34 

40 

43 

48 

? 

8 

11 

17 

20 

22 

33 

36 

44 

47 
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The results of this analysis are similar to the factors obtained by Quay, 

Morse and Cutler (1966) on a sample of emotionally disturbed children in 

special classes and by Patterson (1964) on a sample of children referred 

to a child guidance clinic. This type of analysis is useful in establishing 

the validity of an instrument since it provides specific information 

about the content of a scale (what the scale measures) and also provides 

for a more detailed description of behavior through factorial, profile analysis 

techniques, (See administration and scoring). 

The relationships which exist between the item clusters that make up the 
five factors of the WPBIC are presented in the correlation matrix below. 

Table 6 

Inter-correlations of 
the Five WPBIC Factors 



Acting Out 


Withdrawal Distractability 


Disturbed Peer 


Im-oaturity 


Syndrome 


Syndrome 


Relat ions 




Acting Out 
Syndrome 


.02 .67 


.48 


.39 


Withdrawal 

Syndrome 


.12 


.18 


.23 


Distractability 




.48 


.44 


Disturbed Peer 
Relations 






.34 



Immaturity 



The correlations indicate that with the exception of item clusters one and 
three, there is very little overlap among the five factors. The factors 
seem to be relatively independent of one another. This suggest? that the 
WPBIC measures separate functions of the same behavior domain (e.g. behavior 
disturbance) . 

The r of .67 between acting out syndrome and distractability indicates that 
44 percent of either factor is attributable to overlap or common factor 
variance. The content of the items in each factor supports the assumption 
that the two factors represent common elements. In addition, acting out or 
hyperactive children often manifest very high rates of non-attending and 
distractive behavior (Walker and Buckley, 1968; Paterson et. al, 1965). 

The normative sample of 534 subjects was scored or. the five factors in order 
tain uormed scores for each factor. These data were then converted 
ERJ score distributions for each of the five factors. 

12 
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Table 7 

Distribution of Raw Scores, T Scores, 
and Cumulative Percentages on the 
WPBIC for 534 Subjects 



Acting Out Syn. 


Withdrawal Syn. 


Distract . 


Dist . 


, Peer Rel, 


Immaturity 


Raw Score Cum% 


Raw Score 


Or 


Raw Sc. 


CumJ 


&Raw 


Sc. 


, Cum% 


Raw Sc 


. Cum% 














1 v 






10 


100 


26 


100 










11 




100 


9 


99 


24 


99 




















23 


99 














99 






22 


99 










10 






8 


99 


21 


98 


14 


100 






9 




98 






20 


‘ 98 


13 


99 












7 


97 


19 


97 










8 




98 






18 


97 






13 


100 










97 


17 


96 


li 


98 






7 




97 


6 




16 


96 






12 


99 












15 


95 


10 


97 


11 


98 












14 


94 


9 


94 






6 




97 


5 


96 


13 


94 






10 


96 












12 


94 


3 


93 


9 


93 


5 




95 


4 


84 


11 


93 




















10 


92 


7 


91 


8 


91 


4 




94 






9 


92 


6 


68 












3 


92 


8 


91 






7 


rr 












7 


89 


5 


00 


6 i 

! 

i 


84 


3 




90 


2 


88 


6 


87 




84 , 


5 i 


81 
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Table 7 Continued 




Item Va lidity ; Item variance indices, item validity indices, and item inter- 
correlations were computed on all fifty items of the HPBIC. The maximum 
variance (.25) \;hich an item can have is the point at which the item can make 
the greatest number of separations among individuals. Garrett (1962) 
recommends item variance values of ,24-. 25 for most educational test items 
since it is desirable to make maximum separations among individuals in terms 
of mental ability, aptitude, and achievement factors. However, when construct- 
ing an instrument which will separate a predetermined portion of individuals 
from the total sample, the .24-. 25 value for optimal selection of items do r 3 
not apply. VJith the VPBIC, it was important to select items which were not so 
narrow or limited in scope that they were useless for purposes of identifica- 
tion. On the other hand, a behavior such as not paying attention, is sc 
common and so general that it is probably typical or most school children 
at one time or another. This behaviors i nccuou3 content and extremely high 
frequency would, in all likelihood, negate its value in the identification 
process. Since approximately ter to twenty percent of school children have 
serious behavior problems, a criterion for WPbIC iten selection, or the basis 
of variance indices, was established at from .09 to .16. A value of .09 
equals ten percent possessing a behavior and .16 is equal to twenty percent 
possessing the behavior. 
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Table 8 

Item Variance and Standard 
Deviation Indices for 
Fifty Checklist Items 



Item 


Variance Index 


S.D. 


1 


.12 


.69 


2 


.05 


.47 


3 


.15 


.78 


4 


.08 


.58 


5 


.01 


.25 


6 


.09 


.60 


7 


.02 


.29 


8 


.04 


.43 


9 


.21 


.92 


10 


.14 


.78 


11 


.01 


.28 


12 


.05 


.50 


13 


.17 


.85 


14 


.14 


.76 


15 


.13 


.74 


16 


.05 


.48 


17 


.02 


.33 


18 


.09 


.63 


19 


.11 


.67 


20 


.04 


.45 


21 


.03 


.39 


22 


.01 


.22 


23 


.12 


.33 


24 


.12 


.70 


25 


.02 


.28 


26 


.02 


.30 


27 


.04 


.45 


28 


.03 


.43 


29 


.09 


.63 


30 


.04 


.43 


31 


.03 


.36 


32 


.05 


.50 


33 


.00 


.12 


34 


.01 


.22 


35 


.12 


.72 


36 


.00 


.12 


37 


.06 


.51 


38 


.13 


.73 


39 


.07 


.55 


“A 


.05 


.48 


o 

<ic 


.17 


.84 




15 
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Table 8 Continued 



Item 


Variance Index 


S.D. 


42 


.03 


.59 


43 


,04 


.45 


44 


.01 


.25 


45 


.12 


.73 


46 


.04 


.44 


47 


.00 


.17 


48 


.03 


. 36 


49 


.21 


.93 


50 


.10 


.66 



The range of item variance indices is from .00 to .21 and the item standard 
deviations range from .12 to .93. Seventeen of the items have variance indices 
which fall within the optimal range of .09 to .16 for the separation of the 
disturbed segment of the school population ( approx imately ten to twenty per- 
cent) from the remainder of the school population. The remaining variance 
indices fall either slightly below or slightly above this range with the 
exception of items 33, 36 and 47. The VIPBIC items thus closely approximate 
the criterion of .09 to .16 chosen for judging the variance indices of 
individual items . 



The intercorrelations among fifty scale items yeilded 1,225 coefficients which 
ranged in magnitude from .00 to .83. With the exception of several items 
the results of this analysis confirm the hypotheses that the WPBIC scale items 
are measuring separate functions of the same behavior domain and are not 
excessively duplicating one another's functions. This analysis also provides 
an empirical basis for evaluating the teacher's judgment of behavior problems 
in children. For instance, item #35 reads: "openly strikes back with angry 

behavior to teasing of other children 11 and item #42 reads: "doesn't 

protest when others hurt, tease, or criticize him." These two behaviors, by 
definition, would appear to be incompatible vdthin the same subject. These 
two items intercorrelated at a value of -.03. Similarly, item #6 reads: 
"perfectionistic: meticulous about having e\erything exactly right 11 and 

item #7 reads: "will destroy or take apart something he has made rather than 

show it or ask to have it displayed." These two behaviors appear to be 
logically unrelated and the correlation between them should be low. Items ff 6 
and #7 intercorrelate at a value of ,00. This result is especially signifi- 
cant in view of the fact that adjacent item3 ordinarily intercorrelate highly 
as a function of response set. At the other extreme, items v/9 and #49 both 
measure distractive behavior and intercorrelate at a value of .93. With this 
amount of duplication, either item could perform the function of the other. 



q biserial correlation between scale items and the total score was computed 
CRI/^elding a discrimination index which is a measure of internal consistency 

IB 
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between individual items and test score. The specific procedure involved 
the selection of upper and lower groups, in terms of checklist score, 
according to Kelley's (1939) criteria for the validation of test items and 
then correlating each item with total score which served as the criterion 
variable. 



Table 9 

Item Validity Indices 
on Fifty Checklist Items 



Item 



1 

2 

3 

4 

5 

6 

7 

8 
9 

10 

11 

12 

13 

14 

15 

16 

17 

18 

19 

20 
21 
22 

23 

24 

25 

26 

27 

28 

29 

30 

31 

32 

33 

34 

35 



o 




39 



Validity Index 

.67 * * 

.19 * * 

.67 * * 

.65 * * 

. 33 * * 

.09 

.45 A * 

.42 * * 

. 54 * * 

.61 * * 

. 24 * * 

4g ft ft 
.48 * * 

.65 * * 

.14 * 

.55 * * 

. 19 * * 

.59 * * 

.52 * * 

. 33 * * 

.49 * * 

.12 * 

.39 * * 

.56 * * 

.40 * * 

.35 * * 

.58 * * 

.48 * * 

.40 * * 

.5? * * 

.42 * * 

.60 * * 

.10 

.26 * * 

.62 * * 

.10 

.28 * * 

.55 * * 

.59 * * 
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Table 9 Continued 



Item 



Validity Index 



40 


.30 


ft 


ft 


41 


.53 


ft 


* 


42 


.12 


ft 




43 


.39 


ft 


ft 


44 


.15 


ft 


* 


45 


.36 




* 


46 


.59 


ft 


ft 


47 


.03 






48 


.15 


ft 


ft 


49 


.58 




ft 


50 


.32 


ft 


ft 



** Significant at .01 level * Significant at .05 level 



The item validity indices on the fifty items vary from .03 to .67. Tae 
validity indices indicate that the individual items correlate highly with 
the criterion (total score) and that the items discriminate between subjects 
in the upper and lower twenty-seven percent of the sample in terms of 
checklist score. The item validities suggest further that the items making 
up the WPDIC constitute a very homogenous, related set of behaviors with the 
exception of items 33, 36 and 47 which have indices of .10, .10, and .03 
respectively. 

Educationally Pel at ed Varia bles 

Hypotheses were constructed to determine the effect which non-behavioral 
but educationally relevant variables have upon WPBIC scores of subjects in the 
study sample. These variables include grade of student, sex of student, and 
sex of rater. 



Table 10 

Sex Differences in Checklist* Score on all Subjects 



hale < 


H = 276) 


Female 


(N = 25 §T" 




X 


S.D. 


X 


S.D. 


D Critical Ratio 


10.50 


12.16 


4.83 


7.40 


5.67 6.67 ** 



rt Significant at .05 level ** Significant at *01 level 



0 




18 



-16- 



Table 11 

Grade differences in Checklist Score on all Subjects 



IN = 164) (N = 196) 

Grade 4 Grade 5 




(N = 1741 
Grade 6 






X S.D . X 


S.D. 




X S.D. 


F Ratio 


D CR 










11.23** 




9.48 11.26 8.72 


11.87 








.76 .62 


9.48 11.26 






5.04 7.28 




4.44 4.23** 


8.72 


11.87 




5.04 7.28 




3.68 3.64** 


* Significant at .05 level 




** Significant 


at .01 


level 




Table 12 








Score Differences by 


Sex of Rater on all Subjects 




Male Rater (II = 10) 


Female Rater 


(N = 10) 






X S.D. 


X 




S.D. 


D 


CR 


7.12 10.53 


8.43 




10.39 


1.31 


1.47 


* Significant at .05 level 


^ 


Significant at 


.01 level 




Table 13 








Score Differences 1 


When Subjects Are Rated by a Rater 




of the Same Sex Versus a 


Rater of the Opposite Sex 




Rating Comparisons 


11 


X 


S.D. F Ratio 


D 


CR 


Male (R) rates Male (S) 


148 


9.60 


12.80 17.67** 


1.97 


1.85 


Female (R) rates Male (S) 


127 


11. 57 


11.04 






Male (R) rates Female (S) 


128 


4.26 


7.41 


1.72 


1.89 


Female (R) rates Female (S) 


129 


5.98 


7.00 






Mal^ (R) rates Hale (S) 


148 


9.60 


12.80 






female (R) rates Female (S) 


129 


5.98 


7.00 


4.62 


3.81** 


Male (R) rates Male (S) 


148 


9.60 


7.41 






Male (R) rates remale (S) 


128 


4.26 


7.41 


5.34 


*> 


(R) rates Female (S) 


129 


5.98 


7.00 






(R) rates Male (S) 


127 


11.57 


11.04 


5.59 


t>* 






19 
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Table 13 Continued 



Hating Comparisons 




N 


X 


S.D. F Ratio D 


CR 


Female (R) rates Hale 


(s) 


127 


11.57 


11.01* 




Hale (R) rates Female 


(S) 


128 


4.26 


7.41 7.31 


rtft 



* Significant at .05 level * lf Significant at .01 level 



Table 13 

Sex Differences on all Subjects by Grade 



Grade 


of S 




Male 


Female 




F Ratio 


D 


CR 






N 


X 


S.D. 


N 


X 


S.D. 
























14.25** 






Grade 


4 


87 


12.02 


13.63 


77 


6.62 


9.00 




5.40 


3,13** 


Grade 


5 


102 


12.63 


14.03 


94 


4.47 


6.92 




8.16 


Aft 


Grade 


6 


86 


6.54 


7.81 


87 


3.62 


5.74 




2.92 


2.87** 



Significant at .05 level 



** Significant at .01 level 



In Table 10, it can be seen that male students received significantly 
higher scores on the WPBIC than female students. This result is consistent 
with research findings which have indicated that significantly higher pro- 
portions of boys than girls are identified as behaviorally disturbed. Beilin 
(1959). This finding also strengthens the applicability of the scale for use 
with school populations in that the checklist reflects sex differences 
in behavior disturbance which are known to exist in such populations. 

In Table 11 , the analysis indicates that sixth grade students v/ere rated 
as significantly less deviant than either fifth or fourth grade students. 

There is no empirical evidence, of which the writer is aware, that supports 
this finding. The result may be explained by the fact that the difference 
obtained represents a type one error in that no actual differences exist 
between the two groups even though the data appears to support the opposite 
conclusion. If this explanation were correct, then the null hypothesis would 
have to be accepted instead of rejected for this mean difference. Since the 
critical ratios between both fourth and sixth and fifth and sixth grade 
subjects were significant beyond the .01 level, this explanation is possible 
but highly improbable. Another explanation may be that sixth grade students 
are rated as less deviant than fourth and fifth grade students because of some 
as yet unexplained and unresearched maturaticnal processes. A third possible 
explanation may be that the teachers who rated sixth grade students in this 
study were ’'easier" raters than fourth and fifth grade teachers. 

Uo statistically significant differences were found between male and female 
raters on their rulings of all subjects. This result indicates, as would be 
y ,>ected, that nale raters did not rate subjects as significantly more or 
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less deviant than female raters. 



I 



An analysis of variance applied to the means of a objects rjated by a rater 
of the sr^me sex and subjects rated by a rater of the opposite sex yielded 
an F ratio which was significant beyond the .01 level. HcWver, inspection 
of the respective means indicates that male and female raters do not rate male 
subjects in a significantly different fashion*, nor do male and female raters 



rate female subjects in a significantly different fashion 
sex bias did not appear to be operate in the ratings of to 
The major part of the variance is accounted for by the fac^ 
and female teachers rated male students as significantly irpre deviant than 
female students. 



Thus , a same 
tchers in this sample, 
that both male 



The analysis in Table 13 for sex differences across grades] four, five and 



six yielded an F ratio which is significant beyond the ,01 



of the means reveals that sex differences between male anci female subjects in 



terms of checklist score, held constant across the three f 
be noted that even though sixth grade subjects were rated 
less deviant than fourth and fifth grade subjects, sex dil 
male and female subjects in grade six were statistically 

Administration end Scoring 

S coring : The WPBIC is scored by counting the number of i' 

in each of the four columns on the form. Items marked pr 
columns are then multiplied times their score weights and 
in the appropriate squares at the end of the form. Tor e 
of present item,s in column one is multiplied times one an 
entered in the weighted score box. The number of present 
two is multiplied times two and this figure is entered in 
box under column two. This same procedure is repeated fo 
four. The sub- totals in the four boxes are then added an 
total weighted score box. Thi3 figure is the total score 
on the WPBIC. 

P rofil e Analys is Chart : If a subject receives a weighted 

of 60) or above, then he is classified as disturbed and t 
chart should be completed on his WPBIC ratings below. If 
a weighted score of less than 21, then he is not classify 
the profile should not be completed on his WPBIC ratings. 

The profile analysis chart (PAC) should be completed on a 
referred for further analysis, evaluation, or treatment, 
the receiving agency or professional with specific inform 
behavior disorder. For example, one child may be high in 
and distractabili ty and low in the other factors while an 
withdrawal syndrome and low in the other four factors. 

A subject who receives a raw score equivalent to a T scor 
the factors is considered to be high in the behavioral ar 
5*— that factor. Thus a child who is high in acting 
: a different intervention program than one who is 

} l\!> > i . The PAC is intended to facilitate decision mak 

kmaffaminaa ^ ^ 



level. Inspection 



cades. It should 
as significantly 
ferences between 
ignificant . 



ems marked present 
sent in each of the 
the totals entered 
ample , the number 
this figure is 
items in column 
the weighted score 
columns three and 
entered in the 
foi a subject 



score of 21 (T -Score 
e profile analysis 
the subject receives 
d as disturbed and 



1 subjects who are 
The PAC provides 
tion about the child’s 
acting-out syndrome 
ther may be high in 



of 60 on any of 
a defined by the 
out syndrome would 
igh in withdrawal 
ng in the areas of 



-19- 



psychological/educational diagnosis, evaluation and treatment. 
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W PB1C Profile Anaiysi 5 Cnar t 
Factor I: Acting out Syndrome 



Items 


Score Weight 


(p> 





1. 


X 


(3) 


4. 


>; 


(3) 


;.2 . 


X 


(1) 


\6.“ 


X 


(2) 


;.8. 


X 


(1) 


Wl. 


X 


(1) 




X 


(2) 


30 . 


X 


(2) 


;ii.~ 


V 


(4) 


32. ~ 


X 


U) 


asT 


X 


(3) 


:te. 


X 


(1) 


5;9 ( 


X 


U) 


16 . 


X 


(1) 



(Total) 


Weighted 


Factor 


Score 


] terns 
(P) 




Factor 


11: Withdrawal 

Score Weight 


* 5 . 


X 




(i) 


20. 


X 




(2) 


37 , 


X 




(4) 


42. 


X 




(3) 


45.” 


X 




(4) 


'.Total) 


Weighted 


F actor 


Score 



Syndrome 



Weighted 



Weighted 




23 



Score 



Score 
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Factor IJ.T: Distractability 

Items Score Weight Weighted Score 



(P) 



3. 


>: 


(i) 






6. 


X 


(3) . 






9. 


X 


(4) 






10. 


X 


(2) 




_ 


1J.~ — 


X 


(4) 






14.* 


'< r 


(3) 






10. ’ 


X 


(3) 






24. 


X 


(1) 






4 


X 


(3) 






49. ^ 


X 


Cl) 






(Total) 


Weighted Factor Score 










Factor XV: Fisturbed Peer Relations 







Items 




Score Feifcht*. 


Weighted Score 


(P) 








5. 


X 


a) 




7 . 


X 


(;) 




23 . 


X 


(4) 




25. 


X 


(.) 





25. 


X 


(4) 




28/ 


X 


(3) 


. _ 


34.' 


\9 


(-) 




4C. 


X 


(1) 




43 . “ 


y. 


(i) 


. - 


48. 


X 


(l) 




Octal ) 


Weighted Factor 


Score 









Factor V: T: rr.uturity 




ItOTTu^ 




S:or€ -.'eight 


Weighted Score 


(p) 


2. 


.X 


(2) 




9. 


X 


(4) 




U._“ 


>; 


(2) 




o " 


X 


(3) 


■ — — 


ERIC- 


X 


(3) 
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I ter.3 S core Weight V. 1 el eh ted Score 

(P) 



22. X (1) 

33. x (1) 

36. X (1) 

44. X (1) 

4?. X (1) 



(Total) Weighted Factor Score, 



Plot the weighted factor scores on the chart below to form a profile 
analysis and connect then v:ith a straight line. A horizontal line has been 
drawn across the chart corresponding to a T Score of 60(one s.d. above the 
mean score of the norm sample for each factor.) If a subject receives a raw 
score which corresponds to a T score of 60 or above, he is considered to bo 
high on that factor(s) and could benefit from a treatment program designed 
to remediate behavior disorders represented by that factor. 
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L_ Acting o ut Syn 
ft" -Score ; ‘ Ra^ Sco re' ; . 



10 O 



■1 _ 
26 



95 ,^ 4 ' 
-- ! • 23 



90 



65 



80 



75 



70 



C 5 



60 



- ,22 

.. . 21 



50 



I . 1 



19 
' 18 
17 

■ 15 

■ 15 
. 14 

13 

12 

11 

10 

9 



S3 

ERIC 



Withdrawal, by n. 



Ka w Score ■ * N : 



v -.. 



; * 



14 ' 

h 

n 

10 

9 

8 



Distract :.- rPj^t. Poer Rel 



Raw , S'co . 



Rew Scored . ■ 



r !3 



12 



XI 



. 9 



i 7 



■11 ' 



j i-r 



• 10 . " 



26 



'4 



D ~ 



Immaturi ty | 



lc Ra w Score 





Acting out Syn. 


Withdrawal Syn. 


Distract. .Dist, Peer Rel. 


Inroiat . j 


T-Score 


Kav? Score 


Raw Score 


Raw Scox^e • 


Raw Score 


R. Sr.. 


55 


5 




4 






-- 




3 










4 




3 








3 








1 


50 




2 




1 




— 


2 




j- 










1 










1 


















0 


0 


45 


0 




1 






— 




0 






I 

1 


- - 


! 




i o 




l 

1 


40 


1 

i 




i 

; 


i 


i 

i i 
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The Walker Problem Behavior Identification Checklist 



by 

Hill M. Walker, Ph.D. 



D C - 



: 





a 



NAME 


SCHOOL 


ADDRESS 


GRADE 


BIRTHDATE 


| AGE 




RATER 


DATE 


*■' - - — i ..... 

! KALE 




: FEMALE 



General Instructions 



Please read each item carefully and respond by placing a check ( /) in the 
present or absent .column as it applies to the child. If you have observed 
a behavioral item in the child's response pattern during the last two month 
period, answer the item by marking in the p resent column. If you have not 
observed the behavior in the child during this period, mark in the absent 
column. Hark either present or absent for each item. Do not omit any. 



Examples; 



Sc . 


' Wt. 


Sc. 


Wt. 


Sc. 


Wt. 


Sc. 


Wt. 


1 


2 


3 


4 


1 


A 


P 


1 A 


P 


1 A 


P 


1 A 



1. Has temper tantrums 

2. Has no friends 

3. Refers to himself as dumb, 
stupid or incapable 

4. Must have approval for 
tasks attempted or completed 



ir^rmzi 

dzrz 

r~j iv ’ j 

DCCZ3 



Items Hi and // 4 are rated as present while items #2 and #3 are rated as absent. 
Items marked as present are scored au^ multiplied times their score weights. 
Items marked absent are not scored. (See administration and scoring for 
directions) . 
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V$c. Wt. 


! sc. wt. 


Fsc. wt. 


Sc. Wt. ! 


Items 


1 


i 2 


! 3 


4 i 

- *| * 




|T 1 A 


' P t A 


| P 1 A 


FT a i 



1, Complains about others r un- 
fairness and/or discrimination ______ 

towards him. 1 | | 



2. 


Is listless and continually 










tired. 




1 1 




3. 


Does not conform to limits 
on his own without 
control from others. 


i=r=i 






4. 


Becomes hysterical, upset 










or angry vihen things 




1 


1 i 




do not go his way. 








5. 


Comments that no one 
understands him. 


m 






6. 


Perfectionistic : Meticulous 










about having everything 


i 

i 


1 ] 






exactly right. 








7. 


WiJ 1 destroy or take apart 










something he has made rather 




1 


. J _! 




than show it or ask to have 
it displayed. 








8. 


Other children act as if he 
were taooo or tainted. 








9. 


Has difficulty concentrating 
for any length of time. 


cza 






10. 


Is overactive, restless, and/ 










or continually shifting body 


i 


1 1 






positions . 








11. 


Apologizes repeatedly for himself 










and/cr his behavior. 


i ■ 


I 1 




12. 


Distorts the truth by making 
statements contrary to fact. 


cn 




* 


13. 


Underachieving: Performs below 

his demonst rated ability level. 


m ■ 


* 


■ - 


o 

ERLC 


Disturbs other children: teaming 






- 


provoking fights, interrupting 


■ ■ ■ i. 


! ,] 






others . 
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Sc. Wt. 



Sc. Wt. 
2 


Sc 

3 


Wt . 


Sc. 

4 


Wt. ; 
j 


< P' A 1 


1 P , A 


P 


A 


p i 


A 1 



15, Tries to avoid calling attention 
to himself. 



16, Hakes distrustful or suspicious 
remarks about actions of 
others toward him. 



17. Reacts to jtressful situations 
or changes in routine with 
general bocy aches, head or 

s tomacn aeies ; * nausea . 

18. Argues and must have the 
last word in verbal ex- 
change . 




19. Approaches new tasks and 
situations with an "1 can't 
do it n respense. 

2U. Has nervous tics: muscle - 

t twitching, eye-blinking, nail- 
biting, hand-wringing. 



21. Habitually rejects the school 
experience through actions 
or comments. 



22. Has enuresis. 



23. Utters nonsense syllables 
and/or babnles to himself. 

24. Continually seeks attention. 

25. Comments that nobody like? 
him. 



26. Repeats one idea, thought, 
or activity over and over. 

27. Has temper tantrums. 



28. refers to himself as dumb, 
stupid, or incapable. 



29 not engage in group 

viti^s. 



ERIC 



i — n 
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Sc. 


r 

wt J 


Sc • 


Wt. 


Sc. 


Wt . 


■ Sc. 


Wt. 


i 


2 


3 




i 4 


P 


; a ; 


P 


; A 


Pi 


A 


1 p j 


A 



30. When teased or irritat ed by 
other children, takes out 

his frustrations ) on another 
inappropriate person or thing* 

31. Has rapid mood shifts: depressed 

one moment, manic the next. 

32. Does not obey until threatened 

with punishment. I T 

33. Complains of nightmares, bad 

dreams * | j 

34 . Expresses concern about being 
lonely, unhappy . 

35. Openly strikes back with 
angry behavior to teasing 
of other children. 

36. Expresses concern about something 

terrible or horrible happening | 1 

to him. 

37. Has no friends. 



I 



3&. JJust have approval for tasks 
attempted or completed. 

39. Displays physical aggression 
toward objects or persons. 

40. Is hypercritical of himself. 

41. Does not complete task*; 
attempted . 

42. Doesn't protest when others 
hurt, tease, or criticize 
him. 



43. Shuns or avoids hetero- 
sexual activities. 



44. 



o 

ERIC 





i 

L 



r r i 



OIII 

errj 



Steals things from 
other children. 
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Sc. 


VJt. 


Sc. Wt. 


Sc. 


Wt. 


Sc. Wt. 


1 


2 


3 


4 


P 


jA 


' P f A 


P 


! A 


P 'f A 1 



45. Does not initiate relationships 
with other children. 

46. Reacts with defiance to 
instructions or commands. 

47. Weeps or cries without 
provocation. 






48. Stutters, stammers, or j . 

blocks on saying words. \ [ ' 

49, Easily distracted away 

from the task at hand > l 

by ordinary classroom 

sti’uli, i.e. minor move- 
ments of others, noises, etc. 



50. Frequently stares blankly 

into space and is unaware of his 
surroundings when doing so. 



r~ 

L 



i 



1 


Sc, 


Wt . 

1 


Sc. Wt. Sc. VJt. Sc. VJt. 
2 3 4 


' P I 


1 A 


P i 




lJlJ 


1 p 


A 


1 Number ‘ 






, P.| 


1 


’ 




’ Vk-1 » r QU2 j — 


• I 




i 



■ Latft-ir.'v I 



J + ! ! 



f ? 
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The classroom teacher visually experiences little difficulty in 
pinpointing those pupils whose behavior is deviant or disruptive to 
the classroom setting. The acting-out rMld is generally obvious to the 
casual observer of the classroom. There arc, however , children in the 
classroom catting with equally severe behavioral handicaps who are not 
so easily identified. Children with behavioral deficits resulting in 
social withdrawal are not so cbv/.ous to the teacher or casual observer. 
However, their need for remediation and special services is just as 
great as the acting out child’s. 

A standardised method of observation and assessment in which equal 
attention of the observer or rater is focused on acting-out as well sv 
social withdrawal behaviors would seem desirable. There are a number 
of scales available for rating behavior such as those described by Ross, 
Lacey, cad Pnrton (19G3), Becker, 1960, Nov;’ ck , Rocenfeld, Black, and 
Paws o.i (1966), Dveger, (l°6A) . Quay and Oiuw (1965) and Cromwell and 
Davis (1965). Many of these scales appear to have a high degree of 
face validity. However, there, are. important limitations associated 
with each. For example, one scale is designed for U9e with boys only; 
another is excessively long; and a third is validated with parents as 
ratal's. All those scales appear to be loaded inward identifying the 
child who exhibits deviant disruptive behavior. 

The author has designed a multi-dimensional assessment model of 
increasingly refined levels of observation end assessment for identify- 
ing devient behavior in children (VJalVer, 1969), The instruments are: 
a 50 Item behavior problem checklist (KP31C) which is used as an initial 
screening device (Malker, 1970); a behavior rating scale (BRS) of 62 



lift: s length for collecting data on child bfhavtcr as well ns *:be 
teacher's rerpnnse and reaction to that behavior; and a behavioral obfcr-- 



vat ion form for recording task .-o:. Wanted behavior. Tb^ *™de?. is designed 
to r;\ T 7? c o r‘ f . attention to 4 he identification ar i description o.-: acting- 
Dv.t and roefal withdrawal beV.vior 1 r« children. The Jevelopnent oc ♦‘hecc 
? uy t runer. ts and the validation cf the cbcch.lSst \7?r described in an 
earlier paper (VJalker, 1969). Thta study describes the validation of 
the behavior rating scale (stage Lvo of the assessment model) on an 
inotrunent to idev.tify deviant behavior in children. 



Vtia scales need in the validation procodin trove edmlniFterel 
by j.i tr. ■j where ir\ grades one, through six f.cop three eienontary schools 
of a local district. One of che teachers t^ti£:\t a clcs*. of ten vea: old 
odvcebic mentally retarded children. Each racer was paid for partiov* 
nn*icg in ':;io study upon satisiactoiy completion cf four sets of ratings 
on i.ll clixxdnr.i in hi 3 cla;-s. Teachers in two ot the scuaols heard of 
the prc&vou through the principal at a oteff uaeting. The other teachers-, 
were personalty as.<cd to participate bv tliuT; principal. A total of 
TS6 chtiercn veto rated ir. Vh.u study. 

TjSt3 

Tb^ t^c t bcin? validated, the hvhc-vjoi rot hep, co " I o fjVJd' , ii a 
6? i:;en ncalc containing Rescript ions of behavior that can be o' verged 
in the classroom settirg. The first part of the 3 calc consists of 3> 

^ ?aeh lequ'rlrg three rettng judgments: rate of occurrence of 



T 'etdiOd 



?ubiefU:s. 
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the behavior, rater response to the behavior, and behavioral effects 
or rater reaction to the behavior. The second part of the scale re- 
quires rating judgments only on rate of occurrence of deviant behavior. 
All judgments are mad* on a five point scale from 0-5. Two equivalent 
forms of this scale were constructed. Each scale consist^ of 62 items. 

A pool of 189 items describing classroom behavior were used to 
construct the two equivalent forms of the BRS . A panel of behavioral 
scientists, composed of a school psychologist, a remedial teacher, a 
social worker, a Psychologist, and a child psychiatrist was asked to 
sort the 1S9 behaviors into educationally relevant behavioral categories. 
The expected outcome of the sorting task was a behaviors) classifica- 
tion of the scale items that would be educationally prescriptive and 
that would facilitate treatment decisions and referrals by psychologi- 
cal perscnnel in the school setting. After construction of the behavior 
classification system, these items or behavioral statements were 
further refined and incorporated into a behavior rating scale designed 
to provide data on associated dimensions of deviant behavior. 

Three response measures are obtained on each item in the scale. 

R a t e of o ccurrence provides a measure of the frequency with which a 
given behavior occurs over time. Rate r r esponse Indicates how the 
teacher (or rater) responds to different behaviors as they occur within 
the educational setting. R ater reactio n indicates the extent to which 
a given teacher is disturbed or irritated bv deviant behaviors produced 
within the classroom setting. The rationale fee this response measure 
grows out of the hypothesis that deviant behaviors that are highly 
ating or disturbing to the classroom teacher are significantly 

36 
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more predictive of an educational or psychological referral than are 
equally handicapping deviant behaviors which are less disturbing for 
the teacher. The rating criteria and a sample item are presented 
below ; 

Indicate your judgments in each of the three scoring areas according to 
the following criteria. 

Section A: Rate ot Occurrence 

(0) The behavior has never occurred. 

(1) The behavior occurs at least once every two months. 

(2) The behavior occurs at least once a month. 

(3) The behavior occurs at least once a week. 

(4) The behavior occurs at least once a day. 

(5) The behavior occurs at a constant or near constant rate. 



Section B. Rater Pesponse: When this particular behavior occurs, do you 



(1) Ignore the behavior? 

(2) Give the child a warning glance? 

(3) Interact verbally or physically with the child? 

(4) Temporarily remove the child from the classroom setting? 

(5) Refer the child to an outside source, i.e., counselor, psychologist, 
or separate referral agency? 

Section C: Rater Reaction 



(1) The behavior does not disturb you. 

(2) The behavior disturbs you to a slight exteut. 

(3) The behavior disturbs you to a moderate extent. 

(';) The behavior disturbs you to a great extent. 

(5) The behavior disturbs you to a very great extent. 



Semple Item: 



1. Shouts back 
when cor- 
rected in 
class 



Section A Section B Section C 



Rate of Rater Rater 

0 ecu rrence Res n onse Reaction 



!oi 


ij J 


i? : 3 


4 


5 j 


r i 


‘l 


2 


3 


a\ 


5 


v\ 


2 




4 


5 


1 


II 


i 

! 

f 

v ! ' 

i 

1 






\ 

i 

j 


i — ■ 

x/ 

L 








1 

1 


i 

1 

1 






_ 




i 

i 




This behavior is rated as: occurring at least once a month; the 

rater ignores the behavior; the behavior is moderately disturb- 
ing to the rater. 
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The Devereaux scale for disturbed children (HESB) was correlated 
with the behavior rating scale to obtain a measure of the concurrent 
validity of the BRS. This test, like the BUS, was designed for use by 
teachers in assessing deviant behavior in children within the education- 
al setting, The Devereaux scale is composed of 47 items, 26 of which 
have a five point rating scale (1-5) and 21 which have a seven point 
rating scale (1-7) » The DESB has a test-rctest reliability f or 
factors of .87 with the standard errors for factors ranging from 3,1- 
1,5. The test Is supported by factor and contrasted group validity. 

The 47 items, each of which contributed most to one of twelve factors, 
were selected from a larger sample of items. Children with disturbed 
behavior (from the Devareaux School) were rated as significantly differ- 
ent from normal children on eleven of the tx^elve factors* 

Concurrent validity was also assessed in terms of the BBS's 
relationship to the Walker Problem Behavior Identification Checklist 
(WPBIC) • Since these two instruments are part of multi-stage assess- 
ment model, they should measure the same behavioral dimensions. The 
WTBin consists of 50 descriptions of overt, deviant behavior which the 
teacher rates as being present or absent for each pupil. Items were 
assigned one of four score weights, from 1 to 4, Indicating to what 
extent possession of a behavioral Item handicaps adjustment. The 
Kvder-RIchardson reliability of the WPBIC Is .98. The average item 
validity is .40. Contrasted groups validity Indicates there was a 
statistically significant difference between the mean score of a group 
of disturbed children and the mean score of a group of normal children. 



o 

ERIC i bistria 1 . correlation between checklist scores and criterion scores 
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(based on three criteria of behavior disturbance) was .68. 

The 15 teachers were divided into two groups by school. Six 
of the teachers rated their children on the BRS (forms I and II) and 
the Deveveaux Scale. The nine remaining teachers rated children on the 
ERS (form I) and the WPBIC. The rating scales were left with the 
principal of each school along with a brief instruction sheet for each 
teacher. The teachers were to rate each child in their class on each 
of the two scales. All teachers were asked to rate all the children 
on the BRS before they rated any child on the comparable scale. Ten 
days after they ware delivered, the completed forms were picked up. 
Three weeks later another set of rating scales delivered. Croup I 

teachers were given form II of the BRS (as well as the Dsvereaux Scale) 
and group TI teachers were again given form II of the BRS and the WPBTC. 
Each teacher also received a letter commending th (2 previous effort cud 
reminding teachers of the necessity for identifying each child in the 
sane way as before. The completed scales were collected after nir.a 
days . 

Insert Table 1 About ’-eve 

From Table 1, it can be seen that this study was designed to enable 
calculation of tdst-retest reliabilities for the BRS (form II) the 
UPBT.C, and the Devereaux Scale; equivalent forms reliability for BRS; 
and concurrent validity of the BRS using the Devereaux and FTBIC as 
criterion scales. 
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p esults 



Insert Table 2 About Here 



The data In Table 2 indicate that means and standard deviations 
for both groups were smaller for rating time two than rating tine 
one. This decrease is particularly evident for the means of the BRS 
which Jecreased from 16.9 to 11.2 in group 1 and from 41.3 to 29.4 
in group 2. There was also a large difference in means and Standard 
deviations of the BRS for groups 1 and 2 e.g. means of 16.9 and 11.2 
for group 1 compared to means of 41.3 and 29,4 for group 2. 

Two coefficients of reliability were calculated, the Pearson 
product moment (r) and the intra-class correlation (R) . 



The tedt-retest reliability coefficients varied widely among individual 
teachers. For example, for the BRS, R's ranged from .41-. 88. For 
the HPBIC, the R's ranged from .43-. 96. And for the Devereaux R's 
ranged from .46-. 95. All the reliability coefficients shovm in Table 
3 are below the .90 figure sug 0 ested a9 the minimum degree of reliab- 
ility desirable for selecting individuals from r. group (Thorndike, 1951). 
If the tests were doubled i» length, by the inclusion of valid items, 
the reliabilities would increase: BPS from .74 tc .86, UFBTC from 

.80 to .89: Devereaux from .83 to .91. If the scales were tripled in 
length, BRS would have a reliability coefficient of .89, UPRIC .92, 
and Devereaux .94. Thus, if the scales were lengthened, they could 

level tf reliability suggested as desirable for this purpose 



Insert Table 3 About Here 



Ij • jilts (1951) 
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As with the reliability coefficients, the validity coefficients 
varied among individual teachers. 

Insert Table 4 About Here 

For example, BRS (form I) correlations with the TJPBlC ranged from .57- 
.90. In Table: 4, the correlation of the BRS with the Devereaux was 
highest for form I (.81). The relationship of FRS (form 11} with the 
WPBIC remained constant ever time. As mentioned earlier, the criterion 
scales did not have the reliability deemed optimal by Thorndihe (1951) 
for selecting individuals from a group. If the WPBIC and Devereaux scales 
had reliabilities of at least .90 then the BP%S would correlate at 
least .84 and .75 with the Devereaux and .82 and .83 with the WPBIC. 

Discussion 

In this study, teachers were instructed to rate all pupils on 
the BPS before rating any child on the criterion scale in order to 
restrict the influence of the criterion test on the predictor test. 
However, the data in Table 2 would seem to indicate this instruction 
was not followed. The scoring system for the Devereaux scale resulted 
in much larger scores for deviant behavior than did the scoring proce- 
dure for the WPBIC. Those teachers who used the Devereaux rated thrir 
children much higher on the BRS than did teachers using the WPBIC as a 
comparison Lcale. There could possibly have been a set established for 
rating high or lew on the BRS based on the scores of the criterion 
scale. As a matter of fact, many of the co k pleted scales were grouped 
by child rather than by scale . Another explanation could be that the 
pp \( roup using the Devereaux was more careful in its ratings than group 2. 




-9- 



( Group 1 was the group formed by the principal's personal request to 
each teacher). Finally, the difference in means could indicate that 
children in group l’s school produced higher rates of deviant behavior 
than children in group 2's school. Whatever the source(s) of these mean 
differences, the result indicates that care must be taken in establish- 
ing the criterion for identifying a child as deviant. It must be 
determined that: it is the child’s behavior and not the circumstances 
and setting in which he is rated which indicates that he is deviant. 

The three stage identification process of which the BRS is stage two, 
was designed to eliminate just this kind of uncertainty. 

The differences in the means and variances over time could be due 
to a number of factors. The study was conducted during the last month 
of the school year. It is possible that the children's behavior im- 
proved in an attempt to increase their final school evaluations. The 
lower mean scores of deviant behavior on the second rating could also 
be due to decreased interest on the part of teachers, tilth many end- 
of-the-yecr reports to complete. It would be understandable if the 
teachers rated the chil’ren with less care on these scales the second 
time. However, this difference in mean score was larger for the BFS 
than for the criterion scales and could Indicate a greater annoyance 
with the former. Not only does the FRS have more items than the oiler 
two scales, but half of those ite^s require three different rating 
judgments. In conceivable that if th^ BVS took longer to complete, it 
night be used with less care the second tire th:*n the criterion f.cr.lcs 

which are shorter and easier to use. 

S3 
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The differences in means and variance may appear to be large. 
However, the iact that the product moment and intraclass correlation 
coefficients of reliability are so similar would indicate that the 
differences were not crucial from time to time. The intraclass cor- 
relation coefficient indicates the degree of similarity of two ob- 
servations rather than prediction of one observation from another. In 
the four parameter case used in this study, the R coefficient is based 
on means of the two tests, the product moment correlation between them, 
and a variance (the two tests are assumed to have the same variance). 

This paradigm would test the similarity of two observations, requiring 
that their variances be equal. In this study, the intraclass corre- 
lation would indicate that the BRS (form II), given at different times, 
and the two forms of the BRS given at different times, have a high 
degree of similarity. 

It is interesting that the test-retest reliability of the BRS was 
lower than the equivalent forms reliability. In general, it is expected 
that equivalent forms reliability coefficients will be lower than test- 
retest reliabiltiy. There are two possible explanations for this result. 
Group 2, from whom data was collected for calculating the test-retest 
reliability, could have been a less conscientious group. Perhaps because 
they were personally asked to participate by the principal, group 1 
teachers were more careful raters. Another explanation could be that 
repetition of the sane scale was tedious and thus ratings were per- 
formed haphazardly. However, the fact that both the criterion scales 
had similarly high correlatives would tend to discredit these two 

ERIC ations . 
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The equivalent forms reliability coefficier.t 01 the DRS is high 
and the test-retest coefficient is adequate. However, neither reaches 
the high level of reliability suggested by Thorndike (1951) as being 
desirable for evaluating differences in a group (.90). The Spearman- 
Brown prophecy formula indicates theoretically that by doubling the 
length of the BRS, the equivalent forms reliability could he increased 
to the desirable level. However, the BRS is a longer form than either 
of the two criterion scales and it is also more difficult to use. 
Lengthening the test could, in the author's opinion, decrease its re- 
liability because of the possibility of a fatigue factor. 

The high validity coefficients would suggest that the BRS measures 
the same traits as the V^BIC and the Devereaux Scale. All the scales 
are aimed at measuring deviant behavior, but their approaches differ. 

The WPBIC contains very general items such as ’’underachieving: per- 
forms below his demonstrated ability level” or ’’has temper tantrums”. 

The BRS expands on these iter -13 and gets at specifics such as "is 
easily thrown off and makes errors” or ’’when angry, slam3 books on 
the desk, etc,” These two scales contain items which emphasize overt 
behaviors that the teacher can observe. The Devereaux Scale has items 
that are specific such as those in the BBS. However, the emphasis in 
this scale is on behavior that interferes or competes with academic 
performance such as: "rushes through vrork and therefore makes un- 

necessary mistakes,” "gets openly disturbed about scores on a test.” 

Tn general, items in all three scales appear to sample the same behavior-1 
dimensions . 



o 
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! 

The BRS scale was designed to aid in the Identification of child- 
ren with deviant behavior. The BRS correlates high ? ? with two other 
scales with known contrasted groups validity. The shale a iso records 
charges in deviant behavior rates as a result of trMrment (VJalker, 1 S 5 9 ) . 
However, additional research is needed to determine If the BRS dis- 
criminates between groups of normal and disturbed children. 
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Assessment and Treatment of Deviant Behavior in Children. 
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Table 1 



Design of the Validation Study 





Rating Time 1 


bating Time 2 




April 29-May 8 


May 29-June 8 


Group 1 


BRS Form I 


BHo Form II 


6 Teachers 






153 Children 


Devereaux Scale 


Devereaux Scale 


Group 2 


BRS Form II 


BRS Form II 


9 Teachers 






206 Children 


■ WBIC 


WPBIC 
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Table 2 



Total Means and Standard Deviations 
for Rating Times 1 and 2 



Group 1 Group 2 



_&aS Dover onnx. .BHS_ — Kr3XG_r_ 



^eans 










Rating Time 1 


41.3(Form I) 


121.6 


16.9 (Form I) 


7.6 [ 


Rat leg Time 2 


29. 4 (Form II) 


119.7 


11. 2 (Form II) 


6.4 


Standard Deviation 










Siting Urco 1 


30.9(Form I) 


29.9 


14. 8 (Form II) 


9.3 


Rating Time 2 


27. 6(Form II) 


27.3 


11.1 (Form II) 


7.9 


\ T Tine 1 


153 


153 


200* 


200* 


M Time 2 


153 


153 


206 


206 

_ j 



*one teacher left 6 scales Incomplete on time 1. 
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Table 3 



Comparison of luterclass and 
Intraclnss Correlations Across Ratings 





Devereaux 


BRS 


BRS 


WF Die 






V 


Form I 


Form I 


V 






Pevereaux 


V 


V 


NPBIC 








Form II 


Form II 






r 


.83 


.83 


.74 


.80 


R 


.82 


.83 


r .73 


.78 


N 


| 153 


153 


2C5 


200 
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Table 4 

Concurrent Validity Coefficients 



! 


j BPS v Pevereaux 


cns v UFDIC 


r time 1 ] 


.61(Form I) (.84)* 


. 77(Forrr. H) (.82) 


1 

r tirce 2 j 


I . 72(Form 11) (.75) 


. 78(F om II) (.83) 



‘^corrected for attentuation 
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Stage Two 



Behavior Rating Scale (BRS) 
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BEHAVIOR RATING SCALE 



Demographic Information : 

Name of Pupil 

School 

Sex of Rater 

Name of Rater 



Date of Birth 

Grade 

Sex of Pupil 
Date 
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Instructions to the rater : 

1 This scale is designed for the purpose of identifying behaviorally 
disturbed children. Items in the scale represent OVERT BEHAVIORS 
WHICH CAN BE VERIFIED BY OBSERVATION. Thus, if you have not observed 
a particular behavioral 1 turn in the classroom, you would indicate 
in the scoring section that the behavior ’.ad never occurred. 

2. In the first part of the scale, three rating judgments are required 

for each behavioral item: (a) rate of occurrence, (b) rater response, 

(c) behavioral effects. One judgment is required under (a) rate of 
occurrence; one judgment is required under (b) rater response; and one 
judgment is required under (c) behavioral effects. Thus , there would 
not b£ more than three ratin g judgments per item . 

R ate of occurrence is designed to secure information on the 
frequency with which a particular behavior occurs within the class- 
room setting. For example. If a behavior occurs one or more times 
in a week, you would place a check in book 3 under rati of occurrence. 

Rater response determines how you respond to different behaviors 
as they occur within the classroom setting. For example, you may 
respond to a behavior such as not paying attention with a warning 
glance. On the other hand, you may respond to fighting by temporarily 
removing the child from the classroom setting. Under rater response, 
you are asked to indicate how you respond to different behaviors as 
they occur within the classroom by indicating which of the techniques 
under rater response you typically use in coping with the behaviors 
listed in this scale. It is recognized that you use different techniques 
with the same behavior, depending upon the situation; but you are asked 
to indicate which technique you usually or typically use in coping with 
the behavior in question. 

Behavior al effects indicates how disruptive the behavior is to 
the classroom atmosphere. Some behaviors are very disruptive of a 
learning climate while other behaviors are minimally disruptive* 

3. Rate of items in the first part of the scale as follows: If you 

have observed a particular behavior in the classroom, place a check 
(i^) In the appropriate boxes after that item. If you have not 
observed a given behavior in a child, place a check in the (0) box 
under rate of occurrence and leave the other two sections (Rater 
response and Behavioral Effects) blank for that item. In the second 
part of the scale, simply Indicate the frequency with which behaviors 
occur that you have observed. Read all items carefully and respond 
ro every Item In the scale. 
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4. Indicate your judgments in each of the three scoring areas according 
to the following criteria. 

Section A ; Rate of Occurrence 

(0) The behavior has never occurred. 

(1) The behavior occurs at least once every two months. 

(2) The behavior occurs at least once a month. 

(3) The behavior occurs at least once a week. 

(4) The behavior occuro at least once a day. 

(5) The behavior occurs at a constant or near constant rate, (more 

that once a day) . 

Section B : Rater Response : When this particular behavior occurs* 

do you 

(1) Ignore the behavior? 

(2) Give the child a warning glance? 

(3) Interact verbally or physically with the child? 

(4) Temporarily remove the child from the classroom setting? 

(5) Refer the child to an outside source, i.e., counselor, phyeholo- 
gist, or separate referral agency? 

Section C : Rater Reaction 

(0) Does not apply. 

(1) The behavior is not disruptive. 

(2) The behavior is slightly disruptive. 

(3) The behavior is moderately disruptive. 

(4) The behavior is disruptive. 

(5) The behavior is very disruptive. 

3. Enter appropriate criticisms about the desip^n, item wording, format, and/ 
or directions of this instrument. 



6. Sample item: 



ERIC. 



Section A Section 3 Section C 

Rate of Rater Behavioral 

Occurrence Response Effect 



1. Shouts back when corrected 



0 1 2 3 43 12345 0123 4 5 



i m i * \-A r i mi dzl I 



„ — behavior is rated as: occurring at least once a month; the rater 
ignores the behavior; the behavior is moderately disruptive of a learn^ 



rxlU 
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PART ONE 

Rate of Rater Behavioral 

Occurence Response Effects 

; 0 ! 1 ; 2 13 |4 15 | 1 1 21 31 4j 5 1 0| II 2j 31 4j5 j 



1. Does not obey commands or 
directives . 

2. Terminates an irritating or 
inappropriate behavior if 
verbally reprimanded, only 
to resume the behavior when 
he is not being observed. 

3. Creates a distrubance during 
class activities in which he 
is not interested or skilled. 



1 1 I 1 i I ■ L L UJ 'll! J . I 



m i ■ i ■ t 1 1 



4. Pouts. 



5. Does not play in games with 

other children. ] ' 1 j 1 |l 1 ! ~Tj I 1 1 1 j fT~ 1 

6. Does not attend to a given 

task when asked to do so. j [ I j 1 I 1 I ? j I ! ) I 1 1 i~ 1 



7. Makes verbal statements such 
as : 

You can't make me do this! 





~~r 


; ; i i- 1 i j i i -i- 






0 1 


2 *3 


4 5 ,1.2 3 4-3 0 Jl 2 3 


4 


5 



8. Refuses to do any school work 
for a period of time. 

9. Attempts to yell the teacher 
down in front of the class. 

10. Argues and demands the last 
word. 

11. Leaves the classroom without 
permission. 

12. Refuses to perform or speak 
before the group when 
requested . 



1 i i r n~ i i i t : i : i- .i j j 
rrnTT * rm i 1 1 i n 

i ! i i 1 * ■ i t ■ i i 1 1 i in 



t i ■ j i t~ i lLG • 1 j o n 



13. Screams, bangs objects when . 

denied something, F j ■ TT T j [ ^ \ ' ■ 1 > 1 I I ~ 1 

1* O eeds to do things before 

ructions are finished. 1 1 |~f 1 i [ 1 M 1 j ! 1 j~! ! 

iminaffamniai 
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3ehavioral 
. Effects 



Rate of Rater 
Occurrence Response 



15. 


Does not follow rules of 


!0]T 


2 


3 1 4 1 5 


1j 2 3 1415 


0 


1 


2 


3|4 


5 




games, class activities. 


1 i 




- i 1 

1 1 


' j 1 








n 




16. 


Does not mind or obey until 






physically punished. 


M lj i J 1 il h L.J J!|l 


17. 


Protests about changes in 






his routine. 


li'iii! li ii 


i Lilli 


18. 


Requires control from others 






before conforming to limits. 


1 i * mi; ii i i i i i 1 i j 


19. 


Ignores warnings and repri- 






raands . 


1 : 1 1 II 1 1 | 1 1 1 M 1 f 1 


20. 


Encourages destructive 
activity or disobedience 






in others. 


i 1 1 1 l t i I | iii LI L 1 ill 


21. 


Comments that he hates 






school . 


U : 1 \ j i . j Ml I. .1 _L i 1 1 i. 


22. 


Displays violent temper 






tantrums . 


r* 1 i in 1 1 * i tin i i 


23. 


Engages in fights on the 






playground , 


1 M l 1 1 l M 1 1 1 


1M 


.j i 


24. 


Does not enter into relation- 






ships i7ith other children. 


■ i i i i i i i i rrn i i i 


25, 


Makes lewd gestures. 








1 1 • 1 U II 1 i III! 


i i 


26. 


Shouts back when corrected 






in class. 


L 1 i L Mil 




I 






Ml 








i0 ! l! 
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3U 1 5 1 


1 


J 
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0 


1 


2 


3: 4 
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27. 


Manipulates other children 
in order to get them to do 






what he wishes. 


n i i ii ill; Mi l i im 


28. 


Does not follow directions given 

by the teacher but will follow , 




directions contained in a text- 


IN! ! 1 1 III! 1 i * ■_!. ! .... 




book or assignment. 




29. 


Tattles on other children. 








II 1 ! 1 1 ■ 1 » ■ 


i i i 1 1 ii 


30. 


Makes contrary to fact 






statements . 


1 i 1 ! L • III LI i 1 J 1 I 








31. 


Threatens to kill others. 


1 1 


! 1 i ; 1 i l > I 


1 j ? < ; 


o 







ERIC teases other children* 
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Rate of 
Occurrence 
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33. Starts many activities, but does not finish them 

34. Uses his hands in a clumsy fashion. 

35. Does not initiate conversations with 
other children, 

36. Withdraws when teased by other children, 

37. Apologizes for himself /his behavior. 

38. Utters non-sensical phrases or sentences. 

39. Expresses worry or concern about bad grades, 
health, etc. 

40. Drops an activity when he loses at that 
activity. 

41. Distracted from the task at hand by ordinary 

classroom stimuli, minor noises, movements, etc. i M l | 

42. Loses interest in what he is doing and begins 

to disturb the class, \ \ ? j j 



Li ! n u 
IZ DTTD 
: .jl.UXD 

' ~T~r~TTl 

czjzed 

»“T TP - 



43. Does not take his turn in group activities. 



44. Prefers to play with younger children even 
though children his own age are available. 

45. States others are to blame for his actions. 



46. Tells stories which exaggerate the truth. 



47. Volunteers for classroom status assignments 
but does not finish them. 

48. When presented with a task, withdraws from 
the situation, 

49. Writes phrases in an immature fashion using 

zq and badly formed letters. 

ERIC 



0 1 ' 2 ! 3i 4j 5 ; 

.jLijJjU 



m < i i 



i 1 ! i 
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Rate of 
Occurrence 



50. In structured physical activities, refuses 
to be a team leader if chosen for the 
position. 

51. Requests praise or approval for tasks 
attempted. 

52. Does not ask for directions to be repeated 
even when it is obvious he does not 
understand them. 

53. Mimics speech of others. 

54. Talks out of turn. 



55. Shifts from one activity to the next 
without accomplishing either. 

56. Comments that he is tired. 



lonl 2 3 



I 1 ! !~T f I 

UTTJTZ] 

1 I I Til 

i ll 1 Ml 

rrrrm 




57. Stumbles or falls 

58. Must have things in perfect order. 



1 ° 


1 ! 2 


31 




5 


r~ 




1 


1 1 





59. Seeks approval from teacher for tasks 
attempted. 




60. Comments that he is unable to complete a 
required classroom activity. 




61. Answers questions about himself with ,f I _ 

don't know" or fails to answer. [ j 1 j I I ) 

62. Does not engage in group activities on the 

playground. ill | 1(1 
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Scale II 



BEHAVIOR RATING SCALE 



Demo graphic In f ormation : 

Name of Pupil _ 

School 

Sax of Rater 

Name of Rater 



Date of Birth 



Grade 



Sex of Pupil 
Date 




BO 



- 2 - 



Instructions to the rater : 

1. This scale is designed for the purpose of identifying behaviorally 
disturbed children. Items in the scale represent OVERT BEHAVIORS 
MUCH CAN BE VERIFIED BY OBSERVATION. Thus, if you have not observed 
a particular behavioral item in the classroom, you would indicate 

in the scoring section that the behavior had never occurred. 

2. In the first part of the scale, three rating judgments are required 
for each behavioral item; (i) rate of occurrence, (b) rater response, 
(c) behavioral effects. One judgment is required under (a) rate of 
occurrence; one judgment is required under (b) rater response; and one 
judgment is required under (c) behavioral effects. Thus, there woul d 
not be more than three rating judgments per ite m. 

Rate of occurrence is designed to secure information on the 
frequency with which a particular behavior occurs within the class- 
room setting. For example, if a behavior occurs one or more tines 
in a week, you would plaGe a check ( ) in box 3 under rate of 

occurrence. 

R ater Response determines how you respond to different behaviors 
as they occur within the classroom setting. For example, you may 
respond to a behavior such as not pa ying attention with a warning 
glance. On the other hand, you may respond to figh ting by temporarily 
removing the child from the classroom setting. Under rater response, 
you are asked to indicate how you respond to different behaviors as 
they occur v;ithin the classroom by indicating which of the techniques 
under rater response you typically use in coping with the behaviors 
listed in this scale. It Is recognized that you use different 
techniques with the same behavior, depending upon the situation*, but 
you are asked to indicate which technique you usually or typically 
use in coping with the behavior In question. 

Behavioral effects Indicates how disruptive the behavior is to 
the classroom atmosphere. Some behaviors are very disruptive of a 
learning climate while other behaviors are minimally disruptive. 

3. Rate of items in the first part of the scale as follows: If you have 

observed a particular behavior In the classroom, place a :heck{ ) 
in the appropriate boxes after that item. If you have not observed 

a given behavior in a child, place a check In the (0) bex under 
rate of occurrence and leave the other two sections (Rater Response 
and Behavioral Effects) blank for that item. In the second part of 
the scale, simply Indicate the frequency with which behaviors occur 
that you have observed. Head all items carefully and respond to 
every item in the scale. 
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4. Indicate your judgments in each of the three scoring areas according 
to the following criteria. 

Section A : Rate of Occurrence 

(0) The behavior has never occurred. 

(1) The behavior occurs at least once every two months. 

(2) The behavior occurs at least once a month. 

(3) The behavior occurs at least once a week. 

(4) The behavior occurs at least once a day. 

(5) The behavior occurs at a constant or near constant rate, (more than 

once a day) . 

Section B: Rater Response: When this particular behavior occurs, 

do you 

(1) Ignore the behavior? 

(2) Give the child a warning glance? % 

(3) Interact verbally or physically with the child? 

(4) Temporarily remove the child from the classroom setting? 

(5) Refer the child to an outside source, i.e., counselor, psycholo- 
gist, or separate referral agency? 

Section C : Rater Reaction 

(0) Does not apply 

(1) The behavior is not disruptive 

(2) The behavior is slightly disruptive. 

(3) The behavior is moderately disruptive. 

(4) The behavior is disruptive. 

(5) The behavior is very disruptive. 

5. Enter appropriate criticisms about the design, item wording, format, 
and/or directions of this instrument. 



6. Sample item: 



l. Shouts back when corrected 
in class* 



Section A Section B Section C 
Rate of Rater Behavioral 
Occurrence Res ponse Effect 

0 1 1 2 .3 '4:5 1 '2 ■ 3 -4 !~5l~0l 1! 2! 314^ 



This behavior is rated as: occurring at least once a month; the rater 

ignores the behavior; the behavior i3 moderately disruptive of a learning 
climate. 
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1. Willingly accepts challenges 
and gets into fights. 



Rate of 
O ccurrence 

fO r 1 ! 2 j 3j A t's |lT7~3~;4|5 | 0, L|2j3~|M5j 

rr rrn r i~t 1 1 i i ~rn m 



Rater 

Response 



Behavioral 

Effects 



2. Goes through other children^ 
possessions without author- 
ization . 



mTTTTTi 1 I I l Mil 



3. Responds to teasing with 
physical aggression 



nxiT TT TL.-1-u. mn 






Provokes other children in the 

classroom by disturbing, teasing 

or shoving them. j [ | \\ \ * I 



I DUD 



5. When angry, slams Books on the 
desk, slams doors, kicks chairs, 





etc. | 


r r il l irr i tu 


I_Lj 


LULU 


6. 


Uses profane language in the 














classroom. | 


i "i i i i j l 1 i i r _ 


_J LLLJ 


7. 


Initiates fights with other 














children. 


| i 


'• \ 


1 l 




I 


— 4-h 




i 






o’ 1)2 


3|A*5 


1 ' 2j 3 4 


5 


0 1 


2J3_ 


4 


5! 


8. 


Comments that he hates his 





J : 


! 1 ^ 




! i 


h ! 




I 



teacher. 



9. If the teacher insists that he do 
school work when he has refused, 

throws a temper tantrum, cries, 

9creams, etc. j i T t I 1 L I 1 I T i ll" ! il 1‘ 

10. Provokes fights on the play- 
ground, reports on fight, then 

denies having initiated the , ' 1 I i 1 i I I t 1 I l~ ~[ D j 

fight. 

11. Will destroy or take apart 

something he has made rather 

than show it or ask to have. 1 ) ; I I I I * I { I 1 T T I Tl 1 

l(i displayed. 



12. Threatens other children with 

physical violence. | T I 1 1 1 j j i 1 I I ~ ! I j I 

13. Attacks other children with 
potentially dangerous objects: 

knives, pencils,’ sharp objects, 1 » T Y I I Fit Mil 1 I I 1 I 

etc . 
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14. When angry, will destroy 

his own possessions: books, 

models, pencils, paper, etc* 

15. Refuses to recognize the 
fact when he Is proven 
mistaken or wrong. 

16. Threatens to call in his 
parents to extricate him- 
self from a hostile inter- 
action with the teacher. 

17. Hakes loud verbal outburst 
without raising his hand and 
securing permission to speak. 

18. Cries when things do not go 
his way. 

19. Steals things from other 
children . 

20* Destroys or defaces property 
other than his own. 



Rate of Rater Behavioral 

Occurrence Respon se Effects ^ 

|0~| TT2T3) 4 T 5 j TJ jyg Tjj ] 0 1 1 1 2 1 3 1 

p Hi 1 I. j I i 1 j 1J TTT~? 



rn~~j L i. i . j m unu 



i l~ H~T LI •I'M 1 1 1 ■ . ~ 1 



[xrxrn rnxn □ tup 

QUID ~i~TTT -i..JLi-i-LLJ 
i 1 1 1 ! 1 i TPT_I . Li f ~1 1 '1 

[ 1 jTrn :i. p hi ijllD 



21. Forces the teacher to give him 



her attention. 


y ) 


1 


■ L-J LJ 


I ! i , 1 


jd 


C 

22, Refuses to recite aloud in class!. 


1 j\ 




3^5 


1 


2 ; 3 n a 


o-. 1 


2 i 3 ( A 


O 


□ 


’ ' T 




’ 1 1 


! 


1 j 


.J 



23. Does not express himself orally 

p 1 1 1 1 j jezlei nun 



24. 



Strikes another child and 
then leaves, not staying to 
on with the other child. 



carry 



cr 



11 ‘ 1 1 1 m 



25. Interrupts other children ^ 

while they are working. Q ! T 1 I I j I ! f I * i \ 1 ! I 

26. Pesters other children. | j 1 I 1 | j I ! 1 Tj ~lT ; 1 



27. Imitates the behavior of 
his classmates in a mechan- 
ical fashion. 

28. Asks to be excused from 
activities in which he is 
requited to participate. 



1 1 i 1 1 U ' < ; t j n iT~ T 



rrn m rm Trim 
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Beh avioral 
Effects 



Rate of Rater 
Occurrence Response 



0 1 2 |3 A '5 I 12 ’314:5 | 0jl|2 <3 |4 |5 j" 

29, Uhen mistreated by other _ 

children, takes out his 

frustrations on another 

inappropriate person or thing, I ; 1 I ; j I j | i I [ I | ! | 

30. Corrects other children. ____ 



31. Picks on smaller or weaker 

ch i 1 d r e n . j; : M i i ^ 1 f 11 > 1 i i 1 ^ 

32. tries to settle disagreements 

aggressively, e.g., by bully- i 

ing or yelling. M l T 1 t T T [ ~T T T 1 X ’ l__l . 

PART TtfO 



Rate of 

Occurience 









33. 


Complains of headaches, cramps general body 


JO 1| 2 ! 3 14{ 5 , 




aches . 


j ill] 


34. 


Does not respond to verbal inquiries or 






questions from the teacher. 


'J-i-LL i 


35. 


Hesitates a long time before making choices. 


LJLL_1_U : 


36. 


If not working well at the task assigned, 






drifts off and finds a way to comfort 






himself . 


u LLIJJ : 


37. 


Stutters . 


1 TT T| L- ■ : 


38. 


Comments that nobody likes him. 


1 I! 1 i . ' 



39. 


Is absent from school when a ma5or assign- 
ment or test is due. 


C-LL 


1 i' J 


40. 


Appears tired and lethargic even though not 
suffering fatigue from physical activity. 


CJ l 


a- j 


41. 


Pemains in one position for long periods and 
stares fixedly while doing so. 


L_1_L 




42. 


Shows mjscle irregularities, spasticity, 
rigidities. 


H 


i M ! 


43. 


Comments that a particular activity is 








too hard for him and then quits. 


L_Li 


L±JJ_J 


O 
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44. 


Comments 


-7- 

that a particular activity is 


Rate of 
Occurrence 




too hard 


for him and then quits. 


. 0 : 1 1 2 |3I4“3~ 


45. 


Docs not 


pronounce words clearly. 


| : ! \ 1 



LDLlTZj 



46. Interrupts the class with comments which 

have no bearing on the class activity* * [ \ < ( - 

47* Repeats same acts over and over in a 

mechanical fashion. \ )_} , 



48. Comments that he is stupid. 

49. Complains of difficulty in breathing* 




50. Cries without apparent provocation. 

51. Comments tha, he does not feel well. 



52. Is easily thrown off and makes errors. 

53* Complains of others' unfairness toward 
him* 

54. Although he does not create a disturbance 
or disrupt the class, does not do any 
school work for given periods of time. 

55, Is hyperactive; e.g., constantly moving* 



56. Gives excuses for not getting work in 
on time. 




t 



1 1 I 1- | L-J 




i I I IM 1 



57. Cri'3s whenever the teacher directs 
attention toward him. 

58. Reports difficulty in thinking; e.g., I 
can’t concentrate. 



_1_L 



59. Uses baby talk. 

i ~ T □ r~, 



60, Talks to himself. 



> 

61. Comenta that others are out to get him 
or have it in for him. 




Displays poor coordination in physical 
activities . 
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Stji^e Three 



Behavior Observation Form 
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Re -programing Project 
Oregon Research Inst. 
September, 1968 

OBSERVATION IN THE SCHOOL: DESCRIPTION 0? A CODING FORM 

R. S . Ray, D.A. Shaw, G. R. Patterson 

The following is a trial-and-error refinement of a school observation 
technique used by the project's: observers during the past year. It is a 
method of "characterizing" school situations for a given child in such a 
way as to facilitate understanding the determinants and consequences of 
social behaviors as well as the relationship oi those behaviors to the 
classrt .,ra setting. 

Each coding sheet represents six minutes of behavior for a given 
subject. The "deviant 11 child may be compared to his "normal" peer by 
alternating the two as subjects of observation. (Ne conventionally 
observe the "deviant" child for 12 minutes (2 coding sheets) and ther 
select a "normal" peer at random to observe for 6 minutes (1 coding sheet) 
before returning to the "deviant" child). Each coding sheet provides the 
following inionnation: behavior of tne subject, social consequence, agent 

supplying consequence, and description of the classroom situation. 

The rating form is set up as a grid. Each horizontal line in the 
grid represents a fifteen-second time interval. The grid is divided into 
two-minutc "chunks" sitnply for the convenience of the observer in reading 
the behavior codes. Using the observation clipboard set for fifteen- 
second intervals, the observer moves down one line each time he receives a 
signal from the clipboard, i.e., at the end of each fifteen-second time 
block. (If no clipboard-timer is available, a stopwatch or school clock 
will generally suffice.) The vertical sprees in the grid correspond to the 
behaviors listed at the top of the two-minute section. During each fifteen 

o 
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second interval the observer records both the behavior of the subject and 
the social consequences of his behavior by placing the appropriate response* 
and agent codes in the space beneath i he appropriate behavior code. The 
response codes and the agent codes arc listed at the top of the coding 
sheet* For example, if the subject is not attending to the teacher's 
explanation of the lesson and the teacher "calls him down" (i.e., dis- 
approves) the interaction would le codec' as follows: 

NY AG NA PI IP MQ IV/ NO WK RF VO TI II PL AL 



depending upon the rate at which things are happening in the classroom, 
t:he observer may code more than one subject behavior and more than one 
consequence during each f if teen-oeccnd it terval. Inmost cases, however, 
there will only one primary behavior c r interaction. It is not 
necessary to make more than one coding ei try for behavior which continues 
unchanged throughout the fifteen-second interval. The subject's behavior 
luring the fifteen-second period should >e "characterised' 1 by the coding; 
it need not be described in sequential d stall. The observer should 
check th G situation category at the right side of the coding sheet which 
best describes the situation during each 2-rainute soctica. The categories 
are as follows: 

Classroom? 

r-rou ps To be used whenever the classroom activity is 
essentially group rather than Individual work* e.g., 
teacher presenting lesson to entire class, subject 
in a reading group, etc. 

To be checked whenever the subject is involved 
in individual rather th n grou{ work, e.g., sitting at 
desk doing arithmetic, reading; not listening as a group to 
teacher or working together in a group. 



o 
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Tran si tion : This category will generally be checked v7hen 

entire group is sv/itching from one kind of activity 
to another, e.g. , lining up to go to assembly, moving 
chairs to form a reading group. Frequently is r.ovament 
associated hut it would not be considered inappropriate 
in this situation, e.g., entire class moving from desks 
to reading groups would be coded WO (appropriate group 
behavior) rather than HO (movement). 

Recess : Checked during any regular recess period whether child 

is outside or remains in < las. room. A short description 
of the child 1 s a tivity should be written on the lines pro- 
vided at: the right of each two-minute section (this applies 
to classroom as well as recess behaviors). Generally during 
recess periods, the observer v,ll be primarily interested 
in coding cither PL (playing with others) or AL( isolated 
from others) and possibly AC (aggression)? other behavior 
codes are not so relevant to the usual recess activities. 

Description of Codes: 

CLASSROO M B EHAVIOR S : 

MY (noisy): Coded whenever the subject is talking loudly, 

yelling, or making other deliberate, inappropriate 
noise (such as banging books or scraping choir back 
and forth) which is actually or potentially disruptive 
to others. 

AG (aggression) : Actual or attempted physical abuse of 

another, e.g., John hits Bill or John starts to hie 
Bill and is stopped by the teacher. This includes 
pushing, shoving, threatening, bossy. 

N A (not attending) : Subject is not attending to his 

work or to a lesson being taught, etc.; may be looking 
out the window, watching the observer or other children, 
drawing when he is supposed to be watching teacher 
demonstrate arithmetic, leaning down to tie his shoe, 
turning in his chair. 

PlM'peer initiation): Peer talks to, pokej or in soue way 

trys for att nation of j>. 

I?*Oui tiat ion to peer): talks to, or in some ways trys 

lor attention of peer. 

MO (movement around room): Coded whenever subject ic moving 

around room (other than times when entire greup is moving, 
as in transition periods); observer need not try to decide 
whether each movement is appropriate or inappropriate; 
that question is better decided by comparing rate of move- 
O tnent across subjects. 
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IW ^Inappropriate task): Work on task not assigned or 

specified by teacher for that time. 

NO (appropriate group behavior or normative behavior): Coded 

whenever the subject’s behavior is task-directed activity 
which is appropriate for that time and situation. Included 
would he listening to the teacher explain a lesson, paint- 
ing during an art class, singing with others during music, 
lining up with the rest of the class to go out for recess, 
etc. The observer should take care not to include any 
behavior which might be more appropriately characterized 
as recitation. 

KK (work ) 2 A child may be engaged in appropriate group activity 
bvit not working e.g., observe a movie. VJoik means at desk 
on jl? a 1 e projects . ?hst work on teacher assigned task. 
Record when engaged in reading, writing, arithmetic, basic 



RE (recites): Coded whenever subject recites, answers a teacher’s 

questions, reads out loud, gives a speech, or performs 
before the cla^s. 

VO (volunteers) : Coded whenever subject raises his hand 

or in some other manner indicates a desire to recite 
or do whatever else the teacher may have asked for, e.g., 
someone to pick up papers; may be either in a class 
discussion or in a small group. 

TI (♦’cacher initiation): Coded when the teacher "calls on" 

the subject or comes to his desk or acti^itiy area to 
speak to hitr, this interaction must bo initiated by the 
teacher and not be a response to an Initiation by the subject. 

IT (initiation to teacher): Coded when the subject indicates 

that he wants some attention from tha teacher; he may 
r.'Jise his hand, speak or go to her; this behavior is differ- 
entiated from "volunteer" in that the subject’s initiation 
tn the tncher is not in conjunction with class discussion, 
group study, or reciting. 

R ECESS [ ' - AVI0P.S ONL Y: 

PI \:\cy with others): Coded when the subject is clearly in 

t comp m v of others, whether talking, playing a game 
or Just walking around. 

AL (r/'one, isolated from others): Codod when the subject is 

in eolitp.v" activity, whether plv/*ag a game or not. 



*The3e th "ce categories were added ot expanded by the present authors 
and Buckley) for use ^ ELP. 
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RESPONSES ? 



0 (no response): Coded when no response from teacher, peers, 

or observer follows a behavior. There may be no response 
because the behavior does not demand one or because the 
subject is clearly being ignored, the observer should note 
this at the side rather than attempt to code the response 
any differently). 

A (attention) : Coded whenever the agent listens to or looks at 

the behaving subject; this is a neutral kind of response 
with no obvious approval or disapproval in the attending 
response. 

P (praise): Coded when the subject receives praise or approval 

from sn agent; may be verbal behavior or consist of 
gestures, e.g., smiles, head nods, applause. 

C (compliance): Coded when subject complies with a command from 

another. 

IIC (non-compliance): Coded when subject does not comply with a 

command from another. Neither C oc I:C vjill probably be used 
very often: if they are, they will probably be responses of 
the subject to Tl* 

PH + or - (physical contact positive or negative): Positive 

physical contact would include such behaviors as hugs, pats 
on the back; negative physical contact would include 
aggressive behaviors from an agent such as hitting, spank- 
ing, etc. 

D (disapproval); Coded when a subject behavioi is followed 
by verbal or gestural disapproval from an agent; examples 
might be frowning, negative head nods, ’you shouldn't 
have done that," etc. 



AGENTS : 

Each response should be subscrip tei with one of the following: 

T (teacher), P (peer), 0 (observer) 

to indicate the agent of the response. 0 should rarely have to 
used. 
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